Activity-dependent brain model explaining EEG spectra 
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Most brain models focus on associative memory or calculation capability, experimentally inacces- 
sible using physiological methods. Here we present a model explaining a basic feature of electroen- 
cephalograms (EEG) . Our model is based on an electrical network with threshold firing and plasticity 
of synapses that reproduces very robustly the measured exponent 0.8 of the medical EEG spectra, 
a solid evidence for self-organized criticality. Our result are also valid on small- world lattices. We 
propose that an universal scaling behaviour characterizes many physiological signal spectra for brain 
controlled activities. 

PACS numbers; 87.18.Sn, 87.18.Bb, 84.37.+q, 05.45.-a 
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One of the most astonishing properties of the brain is 
its plasticity, i.e. the abihty to modify the structural and 
functional properties of synapses, occurring mostly dur- 
ing development and learning Qj. The mammalian cen- 
tral nervous system relies on precise synaptic circuits to 
function correctly. These circuits are assembled during 
development by the formation of synaptic connections 
between hundreds of thousands of neurons. Although 
molecular interactions direct the early formation of cir- 
cuitry, this initial patterning is followed by a prolonged 
period during which the establishment of highly orga- 
nized synaptic circuits in the developing human brain is 
thought to depend on neural activity. This transforms 
immature circuits into the organized connections that 
subserve adult brain function JJ. In the central nervous 
system much of this plastic sculpting of neuronal connec- 
tions is thought to occur during " critical periods" of early 
postnatal life when circuits are particularly suscep- 
tible to electrical activity triggered by external sensory 
inputs 3. 

The most compelling and reliable models of activity- 
dependent synaptic plasticity in the brain are Long Term 
Potentiation (LTP) and Long Term Depression (LTD): 
persistent increases and decreases in synaptic efficacy 
that can be elicited in mammalian neurons, based on 
recent patterns of activity. LTP of synaptic transmission 
is traditionally elicited by synchronous, high-frequency 
inputs, whereas LTD typically occurs following repeated 
low frequency afferent stimulation j5|. Strong evidence 
suggests that LTP and LTD are candidate mechanisms 
mediating activity-dependent synaptic plasticity during 
brain development and many forms of adaptive be- 
haviour, including learning and memory 0. 



In the last years maiiy different time series emerging 
from neural activities [l| have been analysed through 
power spectra and generically power-law decay has been 
observed. This behaviour remains unexplained. Under- 
standing its origin is not only a major theoretical chal- 
lenge but also of eminent importance in many applica- 
tions, in particular to give a solid basis to the interpreta- 
tion of EEG ^J^. A large number of time series analyses 
have been performed on medical data that are directly or 
indirectly related to brain activity. Prominent examples 
are EEG data which are used by neurologists to discern 
sleep phases, diagnose epilepsy and other seizure disor- 
ders as well as brain damage and disease An other 
example of a physiological function which can be mon- 
itored by time series analysis is the human gait which 
is controlled by the brain |^. For all these time series 
the power spectrum, i.e. the square of the amplitude of 
the Fourier transformation double logarithmically plot- 
ted against frequency, generally features a power law at 
least over one or two orders of magnitude with exponents 
between 1 and 0.7. On top of this background power law, 
additional structures give information on the details of 
the pathology and can point to specific resonance, fre- 
quency cut-offs and other deviations. While much focus 
is given to these secondary structures, the basic power 
law remains largely unexplained. 

Models for brain activity based on the convolution of 
oscillators ^3 or stochastic waiting times ^3 have been 
proposed. They are essentially abstract representations 
on a mesoscopic scale, but none of them is based on the 
behaviour of a neural network itself. In order to get real 
insights on the relation between these time series and the 
microscopic, i.e. cellular, interactions inside a neural net- 



work, it is necessary to identify the essential ingredients 
of the brain activity responsible for characteristic scale- 
free behaviour observed through the power law of the 
spectrum, as discussed above. This insight is the basis 
for any further understanding of the diverse additional 
features that are observed and interpreted by practition- 
ers that analyse these time series for diagnosis. Therefore 
the formulation of the right brain model that yields the 
correct power spectrum is of crucial importance for any 
further progress in the understanding of the living brain. 

Here we report on a new model that captures the three 
most important ingredients yielding the expected power 
law, namely threshold firing, synapse adaption and net- 
work plasticity, including both LTP and LTD. Despite its 
simplicity our model reproduces with astonishing preci- 
sion the experimentally observed exponent of the power 
spectrum, already for rather small networks. In agree- 
ment with real data, this exponent turns out to be ex- 
tremely robust against modifications of the various pa- 
rameters of the model. With this result we claim having 
made a breakthrough in the generic understanding of the 
diverse electrical time series. 

We consider a simple square lattice of size L x L on 
which each site represents the cell body of a neuron, each 
bond a synapse. Therefore, on each site we have a poten- 
tial Vi and on each bond a conductance gij. Whenever 
at time t the value of the potential at a site i is above 
a certain threshold Vi > I'max, approximately equal to 
—55mV for the real brain, the neuron fires, i.e. gen- 
erates an "action potential", distributing charges to its 
connected neighbours in proportion to the current flow- 
ing through each bond 

v,it + l)^v,it)+v,{t) (1) 

where Vj{t) is the potential at time t of site j, nearest 
neighbor of site i, iij — gij{vi — Vj) and the sum is ex- 
tended to all nearest neighbors k of site i that are at 
a potential Vk < Vi. The conductances are initially all 
set equal to unity whereas the neuron potentials arc uni- 
formly distributed random numbers between Wmax ~ 2 
and Wmax — 1- The potential is fixed to zero at top and 
bottom whereas periodic boundaries are imposed in the 
other direction. 

The system is stimulated at one input (source), a site 
in the centre of the lattice, and the electrical activity 
is monitored as function of time by measuring the to- 
tal current flowing in the system. The firing rate of real 
neurons is limited by the refractory period, i.e. the brief 
period after the generation of an action potential during 
which a second action potential is difficult or impossible 
to elicit. The practical implication of refractory periods 
is that the action potential does not propagate back to- 
ward the initiation point and therefore is not allowed to 
reverberate between the cell body and the synapse. In 
our model, once a neuron fires, it remains quiescent for 
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FIG. 1: Total current flowing in one conflguration of lattice 
(L = 1000) as function of time in a sequence of several 
thousand stimuli. The value of the parameters is a = 0.03, 

at = 0.0001, «n.ax = 6. 



one time step and it is therefore unable to accept charge 
from firing neighbours. This ingredient indeed turns out 
to be crucial for a controlled functioning of our numerical 
model. In this way an avalanche of charges can propa- 
gate far from the input through the system similarly to 
the dynamics of self-organized critical systems |l2j . as 
observed in organotypic cultures from coronal slices of 
rat cortex 1131 w here neuronal avalanches are stable for 
many hours |l4| . 

Every site that at a given time t is at or above threshold 
Umax fires according to eq. (1), then the conductance of 
all the bonds that have carried a current is increased in 
the following way 

g.y(t+l)=.g,,(t)+%,(i) (2) 

where 5gij (t) = kaiij (t) , with a being a dimensionless 
parameter and k a unit constant bearing the dimension of 
an inverse potential. After applying eq. (2) the time vari- 
able of our simulation is increased by one unit. Eq. (2) 
describes the LTP mechanism, whose strength is tuned 
by the parameter a. Once an avalanche of firings comes 
to an end, the conductance of all the bonds with non- 
zero conductance is reduced by the average conductance 
increase per bond, 

Ag^Y.^9^At)/Nb (3) 

ij,t 

where Ni, is the number of bonds with non-zero conduc- 
tance. Eq. (3) implements the LTD process. The quan- 
tity Ag depends on a and on the response of the brain 
to a given stimulus. In this way our electrical network 
" memorizes" the most used paths of discharge by increas- 
ing their conductance, whereas the less used synapses 
atrophy. Once the conductance of a bond is below an 
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FIG. 2: The number of pruned bonds as function of time in 
a lattice of linear size L = 100 for different values of a. The 
value of the parameters is at = 0.0001 and t^max ~ 6. 



assigned small value at, we remove it, i.e. set it equal 
to zero, which corresponds to what is known as pruning. 
This remodelling of synapses mimicks the fine tuning of 
wiring that occurs in the developing brain, when neu- 
ronal activity can modify the synaptic circuitry, once the 
basic patterns of brain wiring are established jl| . 

Our brain is driven by setting the potential of the in- 
put site to the value fmaxj corresponding to one stimulus. 
We let the discharge evolve until no further firing occurs, 
then we apply the next stimulus. Fig.l shows the electri- 
cal signal as function of time: the total current flowing 
in the system is recorded in time during a sequence of 
successive avalanches. As defined above the time unit 
corresponds to the time necessary to propagate the sig- 
nal from a neuron to next nearest neighbours. Data show 
that discharges of all sizes are present in the brain re- 
sponse, reminiscent of self-organized criticality where the 
avalanche size distribution scales as a power law • 

The pruning mechanism introduced in the model de- 
pends on the strength of the parameter a, that controls 
both the LTP and LTD processes. In fact, the more the 
system learns strengthening the used synapses, the more 
the unused connections will weaken. Fig. 2 shows the 
number of pruned bonds in the system as function of 
time for different values of a: For large values of the pa- 
rameter ( e.g. a = 0.08) the system strengthens more 
intensively the synapses carrying current but also very 
rapidly prunes the less used connections, reaching af- 
ter a short transient a plateau where it prunes very few 
bonds. On the contrary, for small values of a (equal to 
0.005) the system takes more time to initiate the prun- 
ing process and slowly reaches a plateau. The number 
of active (non-pruned) bonds asymptotically reaches its 
largest value at the value a — 0.03. This could be inter- 
preted as an optimal value for the system with respect to 
the joint mechanisms LTP-LTD. Indeed LTD seems to be 
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FIG. 3: Power spectra for experimental data and numerical 
data (L — 1000, a — 0.3, Np — 10, Umax ~ 6) for the square 
lattice (middle curve) and the small world lattice (bottom 
curve, L = 1000, a = 0.05, Np = 1000, -Unrax = 8) with 1% 
rewired bonds. The experimental data (top curve) are from 
ref. (16). The numerical data are averaged over 10 different 
network configurations. The dashed line has a slope 0.8. 



the necessary counterpart to LTP in order to modulate 
the synaptic strength [l5| . The asymptotic plateau value 
for varying a is found within the extreme values shown 
in Fig.2. 

After Np stimuli the network is no longer a simple 
square lattice due to pruning, and constitutes the first 
approximation to a trained brain, on which we are going 
to perform our measurements. These consist of a new se- 
quence of stimuli at the input site, each one of them again 
triggered by the voltage set at threshold, during which we 
measure the number of firing neurons as function of time. 
This quantity corresponds to the total current flowing in 
a discharge measured by the electromagnetic signal of the 
EEC In order to compare with medical data, we calcu- 
late the power spectrum of the resulting time series, i.e. 
the square of the amplitude of the Fourier transform as 
function of frequency. 

In Fig. 3 we show the power spectrum obtained with 
our model in a log-log-plot with the parameters a = 0.03, 
Np — 10, at — 0.0001, Wmax = 6 and a lattice of size L = 
1000 and see that it yields a power law with the exponent 
0.8 ±0.1. This is exactly the same value for the exponent 
found generically on medical EEC power spectra |16Lll^ . 
We also show in Fig. 3 the EEG obtained from channel 
17 in the left hemisphere of a male subject, as measured 
in ref. 01 having the exponent 0.795. 

The exponent 0.8 that we observed in the power spec- 
trum of our "brain" is stable against changes of the pa- 
rameters a, Wmax, at, and Np, and it is also found in 
the case of random initial conductance on the bonds of 
the lattice. We also simulate the brain dynamics on a 
square lattice with a small fraction of bonds, from to 
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10%, rewired to long range connections corresponding 
to a small world network [isl l20j . which more re- 
alistically reproduces the connections in the real brain. 
Fig. 3 shows the power spectrum for a system with 1% 
rewired bonds and a different set of parameters a, Np, 
fmax: the spectrum has some deviations from the power 
law at small frequencies and tends to the same universal 
scaling behaviour at larger frequencies over two orders 
of magnitude. The same behaviour is found for a larger 
fraction of rewired bonds, up to 30%. 

Although we cannot justify the exponent 0.8 beyond 
the numerical result of our model, it seems clear that this 
value corresponds to a universal number characterizing a 
larger class of brain networks including real brains. Med- 
ical studies of EEG focus on subtle details of a power 
spectrum (e.g. shift in peaks) to discern between various 
pathologies. These detailed structures however live on a 
background power law spectrum that shows universally 
an exponent of about 0.8, as measured for instance in 
refs. and 0. A similar exponent was also detected 
in the spectral analysis of the stride-to-stride fluctuations 
in the normal human gait which can directly be related to 
neurological activity l^] . We have been able to reproduce 
this universal exponent with a simple electrical toppling 
model that includes pruning. This success is very en- 
couraging since it can provide insight to understand its 
origin and open new perspectives to model pathological 
features of EEG spectra by including more realistic de- 
tails into our model. 
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